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* * NOTICES * 

JPO and NCI Pi are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The image-processing approach characterized by having the step which changes at 
least one of the configuration of the part of the step which extracts the field of said face image, 
the step which extracts the part of a face image from the field of said extracted face image, and 
said face image extracted so that it might make up in said face image, magnitude, and the colors 
based on the image information containing a face image. 

[Claim 2] The step which extracts the field of said face image is the image-processing approach 
according to claim 1 characterized by having further the step which distinguishes said face image 
and images other than said face image. 

[Claim 3] The step which extracts the part of said face image is the image-processing approach 
according to claim 1 or 2 characterized by having further the step which distinguishes said part 
and said face images other than said part; 

[Claim 4] The part of said face image is the image-processing approach according to claim 1 to 3 
characterized by being at least one of an eye, a pupil, an eyelid, eyebrows, opening, a nose, a 
cheek, the skin, and hair. 

[Claim 5] The step which changes the color of the part of said face image is the image- 
processing approach according to claim 1 to 4 characterized by having the step which changes a 
color after detecting the edge of the part of said face image and obscuring near said edge. 
[Claim 6] The image-processing approach according to claim 1 to 5 characterized by having the 
step which specifies the range of the field which changes a color, and the step which displays 
the field to change. 

[Claim 7] The step which changes the color of the part of said face image is the image- 
processing approach according to claim 1 to 6 characterized by having the step which mixes the 
color before conversion of the part which changes a color, and the specified color by the 
predetermined ratio, and changes the color of the part of said face image into the color obtained 
by mixing. 

[Claim 8] The part of said face image is the image-processing approach according to claim 1 to 7 
characterized by having the step which changes the color of said hair so that it is hair, and it 
may pass and AKARA may be given. 

[Claim 9] It is the image-processing approach according to claim 8 characterized by having the 
step which changes the gradation of the field of said hair and changes a color, and the step to 
which extract an edge and edge enhancement is applied about fields other than the edge in the 
field of hair in case the color of said hair is changed. 

[Claim 10] The part of said face image is the image-processing approach according to claim 1 to 

9 which is hair and is characterized by having the step which changes the style of said hair. 
[Claim 11] The part of said face image is the image-processing approach according to claim 1 to 

10 which is eyebrows and is characterized by having the step which changes the color of 
eyebrows. 

[Claim 12] The part of said face image is the image-processing approach according to claim 1 to 

1 1 which is eyebrows and is characterized by having the step which changes at least one of the 
inclination of said eyebrows, die length, and the sizes. 
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[Claim 13] The part of said face image is the image-processing approach according to claim 1 to 
12 which is an eyelid and is characterized by having the step which changes the color of the eye 
shadow given to said eyelid. 

[Claim 14] The image-processing approach according to claim 13 characterized by having the 
step which applies gradation to the thickness of the color changed with the distance from the 
profile of an eye in case the color of said eyelid is changed. 

[Claim 15] The part of said face image is the image-processing approach according to claim 1 to 
14 which is a pupil and is characterized by having the step which changes the color of said pupil 
into a color which equipped with eye contact 

[Claim 16] The image-processing approach given in claim 15th characterized by the thing which 
have the step which changes the gradation of a pupil field and changes a color in case the color 
of said pupil is changed, and to do. 

[Claim 17] The part of said face image is the image-processing approach according to claim 1 to 

16 which is an eye and is characterized by having the step which emphasizes the profile of an. 
eye. 

[Claim 18] The part of said face image is the image-processing approach according to claim 1 to 

17 characterized by having the step which changes the color of said cheek as it is a cheek and 
cheek makeup was given. 

[Claim 19] The image-processing approach according to claim 18 characterized by having the 
step which applies gradation to the thickness of the color changed with the distance from the 
core of said cheek in case the color of said cheek is changed. 

[Claim 20] The part of said face image is the image-processing approach according to claim 1 to 

19 characterized by having the step which changes the color of said lip as it is a lip and opening 
makeup was given. 

[Claim 21] The part of said face image is the image-processing approach according to claim 1 to 

20 characterized by having the step which changes the color of said skin so that it may be the 
skin and foundation may be applied. 

[Claim 22] The image-processing approach according to claim 1 to 21 characterized by having 
the step which changes the color of the part of said face image by making thickness of makeup 
into a parameter. 

[Claim 23] The step which changes the color of the part of said face image by making thickness 
of said makeup into a parameter is the image-processing approach according to claim 22 
characterized by including the step which changes the strength of smoothing in said part. 
[Claim 24] The part of said face image is the image-processing approach according to claim 1 to 
23 which is a nose and is characterized by the step which extracts the profile of said nose, and 
the thing which emphasize the profile of said nose, and to do for step **. 
[Claim 25] The image-processing approach according to claim 1 to 24 characterized by having 
the step which acquires the data of a color to change through either [ at least ] means of 
communications or a storage. 

[Claim 26] The image-processing approach according to claim 1 to 25 characterized by having 
the step which changes the color of the part of said face image by making human being's type 
into a parameter. 

[Claim 27] The image-processing approach according to claim 26 that said human being's type is 
characterized by determining "To boil age, sex, or an occupation/' 

[Claim 28] The part of said face image is the image-processing approach according to claim 1 to 

27 characterized by changing the color of said face image as it is the whole face and a part of 
whole face [ at least ] was tattooed at either. 

[Claim 29] The part of said face image is the image-processing approach according to claim 1 to 

28 characterized by being a pupil and calling for said pupil from the field of an eye by the image 
processing based on a distance transform and the frame theory. 

[Claim 30] The image-processing approach according to claim 1 to 29 characterized by having 
further the step which adds the image of accessories to said face image. 

[Claim 31] The record medium which recorded the program for performing the image-processing 
approach according to claim 1 to 30 and in which computer reading is possible. 
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[Claim 32] Said program is a record medium according to claim 31 characterized by being 
created as plug-in of other applications. 



[Translation done.] 
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1 .This document has been translated by computer. So the translation may not reflect the original 
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2.**** shows the word which can not be translated. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention displays on a display the person photoed by the digital still 
camera, and relates to the image processing technique which changes the expression of the 
face. 
[0002] 

[Description of the Prior Art] A person is picturized by the digital still camera, it changes into 
image data, and displaying a person's image on the display of a personal computer is performed 
based on this image data. By the way, a persons expression changes also with the makeup given 
to the face a lot. However, when the person who became a photographic subject in 
commemoration photography etc. looks at the face image of self after photography, he may 
notice that the contents of makeup (for example, color etc.) were insufficient. However, 
supposing it does makeup again again and performs new photography, the fault of taking time and 
effort and time amount will arise. 

[0003] There is a case where he wants to search for the makeup which was most suitable for 
itself, by checking how expression changes by on the other hand giving various makeup to an 
entire face without make-up. However, since it can adjust separately about the class and color 
of makeup, the accumulating totals of the makeup pattern obtained combining this will become 
huge. Therefore, it can be said that it is impossible as a practical question to check oneself using 
a mirror after giving all the makeup patterns to a self face. 
[0004] 

[Problem(s) to be Solved by the Invention] On the other hand, it is indicated by JP,63-80692,A 
about the makeup simulation system. According to this makeup simulation, by registering 
beforehand the configuration pattern and the color pattern which can be specified of the range 
which changes the color of makeup, and specifying said registration pattern suitably, as the 
makeup was given, it is possible to change the color of a face image etc. and to display on a 
display. 

[0005] However, there is a trouble which is described below in this system. First, in case the 
configuration pattern of the range which changes the registered color is set as either of the face 
images, the handicraft of specifying the display screen top where the face image was displayed 
with a light pen is needed. However, although the registered configuration pattern is beforehand 
decided, for example based on the configuration of an average face, that the configuration (for 
example, arrangement relation of an eye, a nose, and opening) of a face sets up a configuration 
pattern so that it may look automatically in each person's face by people, since it is of infinite 
variety has a possibility that a setup which time and effort requires extremely may be needed. 
[0006] Furthermore, according to this system, in case the color of a face is changed, there is a 
possibility that the boundary part of a discoloration field may look unnatural. Even if a thing 
called the color of a more concrete for example, actual face makes up the same color, it will be 
common that differ delicately partially and it is visible with the hit condition of lighting, the 
redness of a cheek, etc. However, since the color of the registered pattern is set to the uniform 
color (concentration) regardless of the face made up, when this pattern is set as a face image as 
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it is, it is deficient in a cubic effect and has a possibility of becoming the makeup which stuck 
colored paper. 

[0007] In addition, in the actual makeup which gives rouge and eye shadow, not the same 
concentration but gradation is attached over the field made up in many cases, but a setup of 
such gradation cannot be performed in this makeup simulation system, moreover, the color of a 
face with the color of the side to which concentration becomes thin average even if it can 
perform a setup of gradation in this system — not setting up — it does not obtain but, unlike 
the color of an actual face, there is a possibility that an unnatural makeup may be formed by that 
cause. 

[0008] This invention aims at offering the image-processing approach that natural makeup can 

be given by the easy activity in a person's face image. 

[0009] 

[Means for Solving the Problem] The image-processing approach of this invention has the step 
which changes at least one of the configuration of the part of the step which extracts the field 
of said face image, the step which extracts the part of a face image from the field of said 
extracted face image, and said face image extracted so that it might make up in said face image, 
magnitude, and the colors based on the image information containing a face image that this 
purpose should be attained. 

[0010] According to the image-processing approach of the invention in this application, based on 
the image information containing a face image, so that it may make up in the step which extracts 
the field of said face image, the step which extracts the part of a face image from the field of 
said extracted face image, and said face image Since it has the step which changes at least one 
of the configuration of the part of said extracted face image, magnitude, and the colors For 
example, a setup which says the pattern space of makeup that you make it manually located in 
either of the face images becomes unnecessary, and, thereby, the color of the part of a face 
image can be changed simply and automatically. 
[0011] 

[Embodiment of the Invention] Hereafter, the gestalt of operation by this invention is explained 
with reference to a drawing. Drawing 1 is drawing for explaining the gestalt of this operation, and 
the digital still camera 1 and the personal computer 2 are shown in this drawing. Data 
communication is possible for a digital still camera 1 and a personal computer 2 to mutual 
through the serial communication cable 3. 

[0012] In a digital still camera 1, the image data obtained by the image pick-up is transmitted to 
a personal computer 2 through a serial communication cable. A personal computer 2 extracts the 
hair of hair, eyebrows, a pupil, an eyeliner, a cheek, a nose, a lip, and a beige field in a face image, 
can be accessible to the record medium FD which recorded the software for performing an 
image processing convertible into a favorite color, and can install this software now in it. 
[0013] The image processing mentioned later is performed so that the image data obtained from 
the digital still camera 1 may be processed based on the software installed in the personal 
computer 2. In addition, the face image changed by this image processing can be suitably 
checked on monitor display 2a with which the personal computer 2 was equipped. 
[0014] Next, this image processing is explained based on a flow chart and a monitor scope. 
Drawing 2 R> 2 is a flow chart which shows the image processing which processes a face image. 
Drawing 3 , and 4 and 5 are drawings showing the screen display of monitor display 2a. In 
addition, the image data already transmitted from the digital still camera 1 shall be memorized by 
the internal memory (un-illustrating) of a personal computer 2. 

[0015] The software which can perform the image processing which starts the gestalt of this 
operation here shall be incorporated with the so-called gestalt of "plug-in" to basic image- 
processing application software. "Plug-in" means the software which adds a special function to 
basic application. The product name by which Kamiichi is carried out, for example from Adobe 
Systems, Inc. as basic image-processing application software "there shall be Photoshop] and 
this shall be beforehand installed in a personal computer 2. In addition, the application set as the 
object of plug-in is not restricted to an image processing. 

[0016] First, according to basic image-processing application, a user can specify the file on 
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which image data was recorded, and the photographic subject image Ob which contains a face 
image by that cause is displayed on monitor display 2a (un-illustrating). Next, in step S101 of 
drawing^ , a user can choose a face field. More specifically, it can perform using the means of a 
non-illustrated mouse etc. by enclosing the face image of the photographic subject image Ob on 
a monitor by the rectangle frame FO which can change a location and area, selection, i.e., logging, 
of a face field. It means that by choosing a face field had prescribed the field by which an image 
processing is carried out. Furthermore, in step S102, a user can install software which starts an 
image processing from a record medium FD, and can start this software. 
[0017] Since the user has already chosen the face field, according to the installed software, a 
personal computer 2 displays the 1st dialog box ( drawing 3 ) including the started face field FO. 
Here, in the face field FO, a user can choose the eye of the face image Ob, and an opening field, 
and can choose a part of hair (step S104 of drawing 2 ). It is possible by choosing the eye of the 
face image Ob, and an opening field to fit the field where makeup mentioned later is given to an 
individual. Moreover, makeup which gave hair coloring is attained by choosing a part of hair. 
[0018] Like selection of the face field mentioned above, as the mode of this selection can 
change the location and area of two or more rectangle frames F1, F2, and F3, it can move this, 
and it can choose an eye, opening, and a hair field by these rectangle frames. In addition, by 
pushing the O.K. carbon button B1, it opts for a user's selection and, on the other hand, 
selection is canceled by pushing Cancel button B-2. After this selection is completed, according 
to the installed software, a personal computer 2 displays the 2nd dialog shown in drawin g 4 (step 
S 105 of drawing 2 ). 

[0019] next, a user — step S106 of drawi.ng._2 — setting — a 2nd dialog box top — " — it 
passes and a part to change the class, the configuration, or magnitude of makeup is chosen out 
of the carbon button RB1 of AKARA", "foundation", "an eye blow", "eye shadow", an 
"eyeliner", "eye contact", a "teak", "nasal muscle", and a "lip stick." as the following and an 
example — a user — first — " — it should pass and AKARA" should be chosen 
[0020] Following a user's selection, according to the installed software, a personal computer 2 
displays the 3rd dialog box shown in drawing 5 (step S107 of drawing 2 ). The scroll bar SB 2 
which changes the rate mixed with the scroll bar SB 1 which changes the threshold which 
changes the extracted hair field, the color of the original hair, and the color of the hair after 
modification, and the radio buttons RB2, such as a color (for example, it is equivalent to that 
commercial at AKARA) "black" of hair, "tea", "gold", "red", etc. who want to change, are 
displayed on this dialog box. 

[0021] According to the installed software, a personal computer 2 is the rectangle frame F3 of 
drawing 3 , calculates the average of Ri of each pixel value in the field which specified a part of 
hair, j+Gi, j+Bi, and j, and makes it HAIR. AVE. Here, i andj are the locations of the pixel arranged 
in all directions. 

[0022] Furthermore, a personal computer 2 calculates the value of Ri, j+Gi, j+Bi, andj in the 
preselected face field (F0 of drawmgJJ ), and determines the following [ the threshold to which 
the difference with HAIR. AVE was set with the scroll bar SB 1 ] as a hair field candidate pixel. 
Here, a personal computer 2 performs about 8 labeling processing. When a hair field candidate 
pixel is in about eight perimeter of a hair field candidate pixel, it judges with the same RA ** RU, 
and, specifically, let the pixel of the same label as the specified hair field be a hair field pixel. 
Thus, a personal computer 2 can determine a hair field automatically. 

[0023] Here, as an example, when a user chooses the "brown" radio button RB2 ( drawing 5 ) 
(step S108 of drayyin^2 ), as for a personal computer 2, lightness calls the data file on which the 
RGB value of the brown at the time of 0 to 100 was recorded. 

[0024] Furthermore, a personal computer 2 searches for the lightness I of a hair field pixel. 
Lightness I is searched for by the following formulas. 
1=1 OOx (Gi, j/255) (1) 

In addition, the pixel value of G (Green) is used by (1) formula because it is what can reflect 
most the lightness which the pixel value of Green looks at by human beings eyes, and is sensed. 
However, R (red) and B (blue) value are added to G value, and you may make it use them for it in 
(1) type. 



http://www4.ipdl.ncipi.gojp/cgi-bin/tran_web_cgi_ejje 



2005/07/13 



JP.2000-151985.A [DETAILED DESCRIPTION] 



4/9 ^-v 



[0025] By the way, when the color of the hair before conversion is black, even if I becomes a low 
value and it changes it into a "tea" color by this lightness, it will be too dark as compared with 
the hair of general brown. It is convertible after enlarging the value of I for which it asked by (1) 
formula there as was the following. 
1=40+0.6x1 (2) 

[0026] A RGB (R1, G1, B1) value in case lightness is I is read from a data file, and this RGB (R0, 
GO, B0) and the RGB value of a former image are added as follows at a certain rate (rate). A 
user is decided to be arbitration by the scroll bar SB 2 which changes the rate which mixes this 
rate with the color before conversion. 

Rnew=ratexR0+(1-rate) xR1 Gnew=ratexG0+(1-rate) xG1 Bnew=ratexB0+(1-rate) xB1 (3) 
Let (Rnew, Gnew, Bnew) be the pixel values of the target hair field pixel. 

[0027] Only in case of old processing, the field which changed the color does not get used with a 
surrounding field, but there is a possibility of producing sense of incongruity. In order to ease it, 
smoothing can be applied about the pixel near the edge and it can be made to get used with a 
surrounding pixel. About the hair field which consists of hair field pixels, an edge pixel is 
extracted and, more specifically, it is good for the near pixel of the edge pixel for which it asked 
to be made to perform smoothing processing. In addition, the extract of an edge should just 
employ edge detection operators (image processing), such as for example, the Laplacian filter. 
[0028] On the other hand, since the dynamic range of brightness becomes narrow by having 
adjusted brightness based on (2) types, it becomes the low (it considered as the so-called 

image of contrast in many cases. In order to improve this, except the pixel near [ which 
was mentioned above ] the edge, it becomes the image which MERIHARI heard more by 
performing edge enhancement processing of an unsharp mask etc. 

[0029] For example, what is necessary is to choose a white field ( dra>mr\g_3_ ), to perform above- 
mentioned processing ((1) - (3) type) first, to choose the field of black hair ( drawing 3 ) and just 
to perform above-mentioned processing ((1) - (3) type) similarly, when two or more colors are 
being mixed like the black hair which canities cut. 

[0030] A user clicks the O.K. carbon button B1 to end makeup of hair coloring. In a former image, 
the color of hair will be changed into a desired color by that cause (step S109 of drawin g 2 ). On 
the other hand, when changing other parts other than hair (in the case [ Step S1 10 of drawing 
2 ] of Yes), a user can click the carbon button B3 "returning." By that cause, a personal 
computer 2 will return the flow of dr aw ing 2 to step SI 05, and will display the 2nd dialog box 
( drawing 4 ) again. In addition, in the following processings, although the contents itself differ, 
since the processing flow is the same as that of what was mentioned above, the flow chart 
shown in drawin g 2 shall not be referred to. 

[0031] Next, the user should choose "eye contact/' Thereby, a personal computer 2 displays the 
3rd dialog box (un-illustrating) similar to drawing 5 . Radio buttons, such as the image of the 
selected face field, a scroll bar which changes the range to choose, a scroll bar which changes 
the rate mixed with the color before conversion, "black" which is equivalent to the color of 
commercial eye contact by the color which changes a pupil, "blue", and "tea", are displayed on 
this dialog box. 

[0032] First, the pupil of a face image is extracted. It asks for the linear combination Xi and j of 
the RGB value of an object pixel in the field of the eye chosen by the rectangle frame F1 
( drawin g 3 ). This linear combination is calculated by Xi, j=0.3xRi, j+0.59xGi, j+0.1 IxBi, and j. 
[0033] Furthermore, an object pixel and a 4 pixels [ of the perimeter ] difference are searched 
for, and the amounts Ei and j of edges are calculated. Ei and j are expressed with the following 
formulas. 

Ei andj=** — Xi+1, j-Xi, and j**+** — Xi— 1. j— Xi. andj**+ [ ** ] — Xi, j+1-Xi, andj**+** — Xi, 
j-1-Xi, and j** (4) 

[0034] A personal computer 2 calculates average Ave_edge of the above-mentioned amount of 
edges in an object domain. Furthermore, if Ei and j are larger than Ave_edge in an object domain, 
it will judge with the pixel being an edge pixel. 

[0035] Next, about 8 labeling processing is performed. When an edge pixel is in about eight 
perimeter of an edge pixel, it judges with the same label and, specifically, asks for the area Ai (i= 
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label) of each label. Let provisionally the field to which the largest label of area was assigned in 
the field of an eye be the field of an eye. 

[0036] In this field, the peak price of the value of Ri, j+Gi, j+Bi, andj is calculated as Eyejnax. A 
predetermined multiplier, for example, the thing to which 0.35 was applied, is made into TH_EYE 
at Eyejnax, and, finally the value of Ri, j+Gi, j+Bi, andj makes the set of a pixel value smaller 
(that is, darker than TH.EYE) than TH_EYE the field (profile) of an eye in the field of a provisional 
eye. Thus, the field of the called-for eye becomes a thing except the part of pewter. Drawing 6 is 
drawing showing the field of the eye called for by this processing. Thus, a personal computer 2 
can ask for the field of an eye automatically. 

[0037] By the way, since a face image is illuminated from the upper part in many cases at the 
time of an image pick-up, by that cause, the upper part edge of the profile of an eye will become 
dark in the shadow of the illumination light, and a lower part edge will become bright by reflection 
of the illumination light, therefore, originally the field of an eye should be shown in drawin g 6 (a) - 
- although it comes out — a setup of threshold TH_EYE — as shown in drap^rigjB (b) depending 
on how, there is a possibility that the lower part edge UE (part shown by the dotted line) of the 
profile of an eye may fall out 

[0038] Even when the profile of the called-for eye becomes a thing as shown in drawing 6 (b), 
the processing which can ask for the pupil of an eye is explained. It is good to perform this 
processing based on a distance transform and the frame theory. A distance transform means the 
conversion which makes time of concentration of a wave the distance value of the point to each 
point (pixel), when a wave is made to spread toward the interior from the boundary of the graphic 
form used as a processing object. On the other hand, it is defined as a frame as a set of the 
point that a wave collides. Therefore, in the case of a distance transform, it becomes the 
processing which finds the 0-pixel minimum distance in each pixel of a graphic form, and each 
pixel value is changed so that such a high value that it goes to the core of a graphic form may 
be taken. A distance transform is applicable to the extract of the information on the width of 
face of a graphic form, the extract of a shape facility, etc. with this property. 
[0039] The set of the point that on the other hand a value becomes the maximum in the image 
by which the distance transform was carried out serves as a frame, and turns into a set on the 
line located in a part for the core of a graphic form. It is considered that this line is the set of 
the inscribed circle inscribed in a graphic form. Therefore, this can be applied and the largest 
inscribed circle can be regarded as a pupil on the line called for in the field of an eye. In addition, 
about a concrete conversion algorithm, since it is known well, it omits. A user can change the 
radius of this inscribed circle into arbitration with ''the scroll bar which changes the range to 
choose" of the dialog box (un-illustrating) displayed on the monitor display. 

[0040] Also in color conversion of a pupil, the same processing as color conversion of the hair of 
hair is performed. When the color of the pupil before conversion is black, even if the value of I in 
(1) type becomes low and it changes for example, into "blue" color by this lightness also in this 
case, there is a possibility that it may be too dark, as compared with a general blue pupil. Then, it 
is good to change like the case of the hair of hair, after enlarging the value of I using (1) type. It 
can carry out about processing near the edge, and the processing of those other than an edge 
as well as the case of hair coloring. 

[0041] Next, the user should choose the "eyeliner" in drawing 4 . Thereby, a personal computer 
2 displays the 3rd dialog box (un-illustrating) similar to drawin g 5 . Radio buttons, such as the 
image of the selected face field, a scroll bar which changes the rate mixed with the color before 
conversion, a scroll bar which changes the degree which carries out edge enhancement of the 
eyeliner, "black" which is equivalent to the color of a commercial eyeliner by the color which 
changes an eyeliner, "blue", and "tea", are displayed on this dialog box. 

[0042] a personal computer 2 forms the profile (namely, the eyeliner EL) of an eye as shown in 
drawin g 6 (a) by the same processing as the extract of the field of the eye mentioned above — 
it asks a pixel (eyeliner pixel). About this eyeliner EL, edge enhancement can be carried out by 
the reinforcement specified with the scroll bar, and the color of an eyeliner can be changed like 
the case of the hair of hair. In this case, it is not necessary to perform processing near the edge, 
and processing of those other than an edge. In addition, since an eye is shown greatly, a user is 
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made to make an eyeliner thick to arbitration. 

[0043] Next, the user should choose "eye shadow." Thereby, a personal computer 2 displays the 
3rd dialog box (un-illustrating) similar to drawing 5 . Radio buttons, such as a scroll bar which 
changes the image of the selected face field and the range of eye shadow, a scroll bar which 
changes the rate mixed with the color before conversion, "purple" which is equivalent to the 
color of commercial eye shadow by the color of eye shadow, "pink", and "blue", are displayed on 
this dialog box by this dialog box. 

[0044] Drawing J is drawing showing the range of eye shadow. A user can set the range of eye 
shadow as arbitration using a scroll bar, and as a personal computer 2 is shown in drawing 7 t it 
will ask for the field of eye shadow ES from the width of face ESR of the eyeliner EL for which it 
asked by the field extract of an eye, and the set-up eye shadow. 

[0045] Furthermore, a personal computer 2 carries out color conversion of the color of an eye- 
shadow field like the case of the hair of hair. Near the edge, it is good to apply smoothing like the 
hair of hair. In addition, as a modification, the field of eyebrows is determined according to the 
processing mentioned later, and you may make it determine the field inserted into eyebrows and 
an eye as an eye-shadow field. 

[0046] Moreover, apart from the smoothing processing mentioned above, concentration of eye 
shadow can be made thin as it separates from an eye. This can attain the color of eye shadow 
by making it change as a parameter of the distance from an eye (from one to zero). In addition, it 
becomes the color of natural complexion at the time of a parameter 0. (3) types can be used for 
this processing. It becomes possible to acquire effectiveness which required gradation in the 
field of eye shadow by this processing. 

[0047] Next, the user should choose "the eye blow." Thereby, a personal computer 2 displays 
the 3rd dialog box (un-illustrating) similar to drawing 5 . The scroll bar which changes radio 
buttons, such as a scroll bar which changes the image of the selected face field and the range of 
a supercilium, a scroll bar which changes the rate mixed with the color before conversion, 
"black" which is equivalent to the color of a commercial eye blow by the color of a supercilium, 
and "tea", the die length of a supercilium, and a size is displayed on this dialog box. 
[0048] In a personal computer 2, a field setup of the part of eyebrows is calculated from the 
positional information of the field of both eyes. D ra w ing 8 is drawing explaining a field setup of 
the part of eyebrows. For example, the upper left of the ** type field which surrounds a left eye 
RE as shown in drawing 8 , the upper right, The coordinate of the lower left and the lower right, 
respectively as (Xjl Y_uJ), (X_rJ, Y_u_l), (XJJ, Y_dJ), and (X_r_l, Y.dJ) If the width of face and the 
height of a field are made into WidthJ and Height.!, respectively The coordinate (XJJb, Y_ujb) of 
the upper left of the field of eyebrows, the upper right, the lower left, and the lower right, (X_r_lb, 
Y_u_lb), (XJJb, Y_djb), and (X_rjb, Y_djb) are calculated as follows, respectively. 
Xjjb=XJJX^rJb=X_rJY.uJb=Y_uJ-HeightJY_dJb=Y.dJ-HeightJ (5) 

In this rectangle field, a left eyebrow field can be extracted by the same technique as the extract 
of the field of an eye. In addition, it can extract by the same technique also about the right 
eyebrow of the right eye LE upper part. 

[0049] About the color of eyebrows, the color changed from radio buttons, such as "black" 
corresponding to the color of a commercial eye blow and "tea", can be chosen, and color 
conversion can be carried out by the same technique as the hair of hair. Moreover, the die length 
of a supercilium and a size are changeable with a scroll bar. What is necessary is to expand a 
supercilium field to horizontal or a perpendicular direction, and just to reduce, in order to change 
die length and a size. Furthermore, you may enable it to change the inclination of eyebrows etc. 
according to epidemia. It can ask for the inclination of eyebrows by changing the coordinate of 
eyebrows. 

[0050] Next, the user should choose "nasal muscle." Thereby, a personal computer 2 displays 
the 3rd dialog box (un-illustrating) similar to drawing 5 . The scroll bar which changes the degree 
of the image of the selected face field and the edge enhancement of nasal muscle is displayed 
on this dialog box. 

[0051] A field setup of the part of a nose is the range above the field of opening below the field 
of an eye, detects a nostril and presumes nasal muscle from the location of a nostril. What is 
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necessary is just to let it be a nostril field, if detection of a nostril has the value of Ri, j+Gi, j+Bi, 
andj smaller than the average of the value of Ri in an object domain, j+Gi, j+Bi, andj for example, 
in an object domain. Moreover, what is necessary is just to presume that nasal muscle is on the 
perpendicular 2 bisectrix of two nostrils. 

[0052] A user can do edge enhancement of the edge equivalent to the called-for nasal muscle 
according to the degree of the emphasis specified with the scroll bar. In addition, a nose can be 
highly shown by making deep the shadow on the right-hand side of nasal muscle, when the 
illumination light has hit from the left, and making deep the shadow on the left-hand side of nasal 
muscle, when the illumination light has hit from the right. 

[0053] Next, the user should choose the "teak." Thereby, a personal computer 2 displays the 
3rd dialog box (un-illustrating) similar to drawing_5 . Radio buttons, such as a scroll bar which 
changes the image of the selected face field and the range of a cheek, a scroll bar which 
changes the rate mixed with the color before conversion, and two or more BINKU colors which 
are equivalent to the color of a commercial teak by the color of a cheek, are displayed on this 
dialog box. 

[0054] Drawing . 9 is drawing for explaining a setup of the field of a cheek. A field setup of the 
part of a cheek should just make the field surrounded with this circle the cheek field CR by 
drawing the circle which made the y-coordinate the core of a nostril of having detected the core 
CRC of a cheek by the extract of nasal muscle, and made the default 0.5 times of the distance 
from the core CRC of a cheek to the core of a nostril for the radius by making into an x- 
coordinate the core of the pupil detected by the extract of an eye, as shown in drawin g 9 . A 
user can make it possible to change the radius of this circle with a scroll bar. In addition, this 
circle can also be made into an ellipse according to the stereoscopic model of a face. 
[0055] What is necessary is to apply on the outskirts from the core of a cheek, to make small 
the original flesh color and the rate to add gradually, and just to make thickness thin, although 
color conversion is carried out like the case of the hair of hair so that a user may become the 
color chosen with the radio button in principle. Thereby, effectiveness to which gradation was 
applied is done so. 

[0056] Next, the user should choose the "lip stick." Thereby, a personal computer 2 displays the 
3rd dialog box (un-illustrating) similar to dra wi n g 5 . Radio buttons, such as a scroll bar which 
changes the image of the selected face field and the range of a lip, a scroll bar which changes 
the magnitude of a lip, a scroll bar which changes the rate mixed with the color before 
conversion, two or more red which is equivalent to a lip stick commercial color by the color of a 
lip, and purple, are displayed on this dialog box. 

[0057] First, in order to ask for the field of opening, it asks for the linear combination Xi andj of 
the RGB value of an object pixel. This linear combination is calculated by Xi, j=0.21xRi, j-0.52xGi, 
j+0.31xBi, andj. 

[0058] Next, a 4 pixels [ of perimeters ] difference is searched for, and the amounts Ei andj of 
edges are calculated. Ei andj are expressed with the following formulas. 

Ei and j=** — Xi+1, j-Xi, and j**+** — Xi— 1 . j— Xi, and j**+** — Xi, j+1-Xi, and j**+** — Xi, j- 
1 — Xi, andj** — average Ave.edge of the above-mentioned amount of edges in this object 
domain is calculated. If Ei andj are larger than Ave.edge in an object domain, it will judge with 
the pixel being an edge pixel. 

[0059] Furthermore, about 8 labeling processing is performed. When an edge pixel is in about 
eight perimeter of an edge pixel, it judges with the same label and, specifically, asks for the area 
Ai (i= label) of each label. Let the field to which the largest label of area was assigned in the field 
of opening be the field of a lip. 

[0060] The average of Ri, j+Gi, j+Bi, andj is calculated in a lip field, and if it is 1.5 or more times 
of the average, the pixel can be removed from an object pixel as a pixel equivalent to a gear 
tooth. Furthermore, color conversion is carried out by the same conversion as the hair of hair so 
that it may become the lip stick color chosen by the user. What is necessary is to expand a lip 
field and just to reduce to change the magnitude of a lip. Thus, a personal computer 2 can 
extract an opening field automatically. 

[0061] Finally, the user should choose "foundation." Thereby, a personal computer 2 displays the 
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3rd dialog box (un-illustrating) similar to drawing 5 . The scroll bar which changes the image of 
the selected face field and the beige range, the scroll bar which changes the thickness of 
makeup, and two or more beige radio buttons which are equivalent to the color of commercial 
foundation by the color of the skin are displayed on this dialog box. 

[0062] First, the ** value which detects a beige field is inputted and the beige field which does 
not contain an eye and opening is detected. Specifically, it asks for the linear combination Xi and 
j of the pixel in a face field. Here, i and j are the locations of the pixel arranged in all directions. 
This linear combination is calculated by Xi, j=Ri, j+Gi, j+Bi, and j. 

[0063] Next, a 4 pixels [ of perimeters ] difference is searched for, and the amounts Ei and j of 
edges are calculated. Ei and j are expressed with the following formulas. 

Larger than ** value TH_edge into which Ei and j were inputted in this object domain Ei and j=** 

— Xi+1, j-Xi, and j**+** — Xi-1, j-Xi, and j**+** — Xi, j+1-Xi, and — Xi, j— 1 — Xi, and j** 

— And it is not the field (field of the whole eye instead of a pupil) of the extracted provisional 
eye, either, and if it is not the field of detected opening, either, it will judge with it being a beige 
field. In addition, after extracting the field of the skin previously, you may make it extract the 
field of an eye and opening within the limits of it, for example, although the field of a face image 
can be extracted by combining the field of hair, the field of an eye, the field of opening, and the 
field of the skin. 

[0064] It is changed into the color of the foundation chosen by the user by the same color 
conversion as the hair of hair. What is necessary is to make low the original beige rate at the 
time of adding with the original flesh color, or just to strengthen the degree of smoothing of a 
beige field, so that the thickness of makeup is deep to change the thickness of makeup. Thereby, 
amendment of surface deterioration etc. is attained. 

[0065] Thus, according to the gestalt of this operation, by easy actuation of a user, a personal 
computer 2 can extract automatically and correctly the field of the part which gives makeup in a 
face image, and can give natural coloring like actual makeup according to a demand of a user 
further. 

[0066] Furthermore, the mode which makes up simpler as a modification of the gestalt of this 
operation can be considered. For example, the radio button with which age, such as "his teens", 
"his twenties", "his 30's", and "his 40's", is expressed as a modification of the 2nd dialog box is 
displayed, and it is also considered that the makeup which represents an age in the image 
photoed by the digital still camera is made to be given automatically. 

[0067] The mode of the makeup which represents each age first is more specifically set up 
beforehand, parameters (a rate, a size, die length of a supercilium which are mixed with the color 
of a part and the color before conversion) are determined for every each part grade mentioned 
above corresponding to it, and it memorizes in memory. According to the user having pushed the 
age carbon button, a corresponding parameter is called and the color of the part of the displayed 
face image etc. can be changed. Of course, a more abstract expression, for example, the 
expression like a "young man", "an adult", the "middle age", and a "small mother", is sufficient 
as the radio button showing an age. 

[0068] According to this modification, without setting up the various parameters accompanying 
the conversion like each part of a face, only by choosing the parameter showing an age, various 
parameters will be set up automatically and average makeup will be given in the age. 
[0069] It is also possible others and to give man and woman's sex as a modification to a 
parameter. Even if makeup of a male is given, it is made not conspicuous in many cases, and it is 
made comparatively conspicuous [ makeup of a woman ] in many cases. Thus, it is good to set 
up various parameters so that makeup of a typical man and a woman may be suited. In addition, 
when makeup of a woman is applied to a male face image, it will come, whenever it disguised 
itself as a woman and special effect will be acquired. 

[0070] Furthermore, giving a specific occupational description to a parameter as another 
modification is also considered. Specifically, occupational descriptions, such as a "candidate", an 
"actor", and a "Kabuki actor", can be considered. In makeup of a candidate, it is not 
conspicuous in many cases, and makeup of a Kabuki actor is showy to it. It becomes possible to 
give simply makeup represented by the corresponding occupational description by setup of this 
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parameter in the face image displayed on the monitor display. In addition, a parameter may be 
set up more concretely. For example, you may carry out as [ give / makeup approximated to 
"Mr. A of a heavy metal rock group", "Mr. B of a young female singer", "the C of a stand-up 
comedian", etc. / the face image displayed on the monitor display by a user's selection ]. [0071] 
On the other hand, it is more convenient if a user enables it to update easily the color changed 
like each part. For example, if "updating" carbon button B4 displayed on the dialog box ( drawing 
5 ) at the time of choosing "hair coloring" is pushed when a user wishes to apply another color 
to the color of hair coloring, as shown in drawing JO t the dialog box which chooses the new color 
of hair coloring will newly be displayed. A user can add fresh color to the dialog box of drawing 5 
by choosing a favorite color from a carbon button D1. 

[0072] Furthermore, it is also considered that a user forms the image which gave makeup which 
took in the fresh color this year which a cosmetics manufacturer proposes. In the dialog box 
which specifically chooses the new color of hair coloring shown in drawing 1 0 , a user can 
choose CD-ROM as a record medium with an accessible personal computer 2, or the Internet as 
means of communications. The data of the color which a cosmetics manufacturer proposes are 
contained in this CD-ROM, and a user can use the data in the file saved at this CD-ROM, when 
CD-ROM is chosen. 

[0073] On the other hand, if a user chooses the Internet, he can access a cosmetics 
manufacturer s homepage etc. and can download the data file of the newest color from this 
homepage. The same procedure enables it to also add a color besides foundation. In addition, a 
data file consists of data showing colors, such as CIEL*a*b*, CIEL*u*v* or RGB, and CYMK. 
[0074] According to this modification, a user can update the color of makeup to try easily. 
Moreover, if it sees for a cosmetics manufacturer, some colors which are the most popular now 
can be judged and it will become possible to correspond to epidemia of the intense time of 
changes promptly from the count of the downloaded color data. 

[0075] As mentioned above, when forming the face image which made up according to the 
gestalt of this operation, while being able to perform the block definition of the part of a face 
image easily and correctly, color conversion can be performed so that it may approximate by 
actual makeup. Moreover, the data of a color to change can be easily updated now so that it can 
respond to makeup of epidemia. 

[0076] As mentioned above, although this invention has been explained with reference to the 
gestalt of operation, this invention is limited to the gestalt of the above-mentioned 
implementation, and should not be interpreted, but, of course, modification and amelioration are 
possible suitably. For example, although it may write in like the tattoo to the bottom of an eye of 
the graphic form in which a tear is shown as one mode of makeup, effectiveness as if the graphic 
form was tattooed can also be acquired by applying the gestalt of this operation and changing 
some colors of a face image. Moreover, you may make it form a desired hair style by making the 
location and area of hair change into arbitration in a face image. Furthermore, as an option, 
accessories, such as a hat, a hair ornament, a comb, KACHUSHA, and an earring, a pierced 
earring, are beforehand memorized to the internal memory of a personal computer 2, and adding 
to the face image which had this made up suitably is also considered. 
[0077] 

[Effect of the Invention] According to the image-processing approach of the invention in this 
application, based on the image information containing a face image, so that it may make up in 
the step which extracts the field of said face image, the step which extracts the part of a face 
image from the field of said extracted face image, and said face image Since it has the step 
which changes at least one of the configuration of the part of said extracted face image, 
magnitude, and the colors For example, a setup which says the pattern space of makeup that 
you make it manually located in either of the face images becomes unnecessary, and, thereby, 
the color of the part of a face image can be changed simply and automatically. 

[Translation done.] 
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JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is drawing concerning the gestalt of this operation showing a digital still camera 1 
and a personal computer 2. 

[Drawin g 2] It is the flow chart which shows the image processing which processes a face image. 

[Drawing 3] It is drawing showing the screen display of monitor display 2a. 

[Prayying 4] It is drawing showing the screen display of monitor display 2a. 

[Drawing 5] It is drawing showing the screen display of monitor display 2a. 

[Drawing 6] It is drawing showing the field of an eye. 

[Drawin g 7] It is drawing showing the field of eye shadow. 

[Drawing 8] It is drawing explaining a field setup of the part of eyebrows. 

[Drawing 9] It is drawing for explaining a setup of the field of a cheek. 

[Prawing_1_0l It is drawing showing the dialog box for choosing the new color of hair coloring. 
[Description of Notations] 

1 Digital Still Camera 

2 Personal Computer 
2a Monitor display 
FD Record medium 



[Translation done.] 
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w&ttztmm 1 7122 5©i*r*i^Kiis»©ii»«!i 

{IB** 2 7 } WIBAIH©* 4 * 4 Witt 

[»3jqi2 8 ] frsBnraft©a&t*. §&ftT£>9 , 10 

a 1 7122 7©c^n^«:gatt©li««!:ffi*ffi. 
[||*JI2 9 ] S»Bgnilk©ffitttt. «-C*9 . BuiB 
■I*. ffi«K»Rtf#ttaiMcS-3< MHKffiatc J: 0 , 
B©ffl«tt»6;Rtf>6ftSC i*eai-r-5»*JH 1 712 

[ 3 o ] iw mmmt , rnKsuowmzimir 
2 9 ©i»-rtu&»«:Ett©ii<ft*affi*ffi. 20 

[M*3S3 1 ] 1 7123 0©C^*rti*>CCIBtt© 

> t: * - * R&K «3 liJtB&SE»JBH*. 

«S3 1 KIBttORIMW*. 
tO 00 1 ] 

[0 00 2 ] 

lUXO&ffi) ?^*rt^*;u;&^5lcJ:i3A«*f«« 
^v^XDf^ ^^U-f±tcA«©iB**aSfSC<k 

*CC*5tit:»^(t«!:teo/cA«J*i, SHBatceB©HBi 

[0003]-*, ±<<Dmmfcttbzm*<D{mzm 



»BB 2000-151985 

[0 00 4 ] 

3 - 8 0 6 9 2-^-Kltt, >-^79^;al/-^3> 
[0 00 5 ] <L£5#, fcJtP&t'X^AtCtt, fiiTKia 

amfcoi^rtifrecBBej-* 

fc»tt>* * - > tt. fc £ A «^ftW&g|<3WI?«CcS^l > 

a, p©ieBBB«) wAKA^r^piiTJM-c**^ 
6, ffl^©A*©««:*jc»r, S4Ricjl*SJ:5KJ6tt 

[0 00 6 ] H*c. ^^i/^f-AtC^titf, MO&Z 
fife'* ^-*3ft*S£ttfcM««:Hi 

^•k*<d* fiftiBcczK. ^/c& 

a* tt 0 « wfc J: ^ ft ^ - ^ i & r u * 5 

[0 0 0 8 ] A»©»iB«CC, 1B#&ft«-C 

[0009] 



(4) 

5 

bfcOTE«iH*©«J**>6 . MBfc©»fc*Wffl*** 

f-^'i. fnBaHftKKbtEiJfc-ri^K:, iaajsn/c 

ttHidnfcOT2fflil*©8Bffl©JBtt, *£3Ri>' 

"C, /c<t;u«ttt©^ ^tat-caia*© 

0. -entc<fc»3jB*K:^oa«8«:HBi«sc!)att©fe«:a 
JE"f SCi**?**. 
[00 11] 

[£W©llft©JftB] WT\ *3WlfcJ: **«©»« 
[0012] j< v 1 KfcUT, JlfttC 

/tot, n*y3>2tciiHiS*i*. ^V3>2B, an 
«cfci>rit©^ Jl> ■« 74v4>. & 
Bi&««*aui/, s?*©e«:^jRpis8ttiiifc«ia*ii 

*ff £fc#>©V7 Y $x7*K»UfcgEfi«ttF DK7 
[0 0 1 3 ] ^*yn>2 CC-f h-;U3tifcy 7 30 

[0 0 14]&fc, *>*>-5H«jfia*. 7P-^ + -h 
■CftS. H3, 4, 5tt. 7 W 2 a©iB 

[ o o l 5 3 c c t\ *Hifc©»lBK:^Sil«*affl% 
HfToJtB&y? ^xrtt b*£&se**H7:^ 

BrflMii****©***. r^y^^j iti, a 
$ £ fc -5 7 7* >; - 3 > k» b r «3*tt««B*ffljDr 

Svn^xr^Iftt^ S*ittSH««Hl7^ I J 

«S#a^6±r)JStirt^Ha B n« Tph 0 t 0 S h O 50 



«H32 0 0 0- 1 5 1 93 5 
6 

p]#*0. cn«^^*v=i>2tc>f>x h-;u$ti 

[0016] B*ift-5Bi»«iffl7^ , J^-^3 
W^St^Ci^-C^. *ftfcJ;9aiB«**M«¥ 

(^B?S) o H2©^f 1 0 ik:*ji»t, 

ftttfctt, ^^©^*«©*®*rfflt>T. *~£_h 

B»Ob©S0Blfc*H^ctCCJ:r) % XH«OS» a r«c 
=b*tt9fflL«MC a*Mt©aK«r5 

SK* — !f-W\ *r ?7'S 1 0 2K*5l>T 4 ea 
JSE{*FD3&»61ift®atC3&>*>SV7 h^i7(D^>^ b 

[0017] *~y-i)Wfcm$m*miRLx^z><D 

2« v «ouisnysca««F o*^*i ©y-f7P^ 
(^3) iS^-rsAStettoru*. cc 

awtawu **«©-»*«««€: 

<H2©*?-7:7S 1 04) . HB«Ob<DB, □«« 

[0018] ^^satRCDiftHitt, ±au/c«««©a 

F 1 , F 2 , F 3 CD{4® * ffi 

«««*aiR'i-sci3&S'ct-5. o 

«R*«IB»3ti-5J:5K:^-ort^. *>^-satR^»7 

n>2tJ, H4tC7ft-r»2©^-f7Dy**7S-r^J:9 
KScoTl^a (H2©Xf -^S 10 5). 
[0019]^ a— H2©^f*9^S10 
6CC*Jl>r. #2©y47n4/?K*£X±© r^7^7 

-j r^yv-f-^avj r7^^n-j r7^2/+F 
r«Bj rpflj <o#3i>rb i©*3&>e>, {btt©aa 

[0 02 0] :z-tf-©aJWCj£B)U ^>^h-;U3 

ti/cv^ h^x7tcsec^ ^V3>2«, msictjktm 



10 



(8 2©*f*7 7*S 10 7). C<D#<<7X2#tfy2Z 

-U^'-SB 1 7C©§t©fe£, SH»©*Ofeiil 
£r*«££g***£n-Jl/'<-SB2<h. ^Kbfc 
l»»©fe (fcixtfr|iJIR©^7*7-CCfflS'r&) 

rjy r^j r^j rssj 9©?y*#*>RB2#is 

[0 02 1 ] h-JUSti/tV? h$x7fcfi£l^ 

^3>2tt, H3©ffiJFJttF3T. S©-aJ*JBjei/ 

ftlffi**«). HA I R_AVEit^o CCT, i, j 

[0 02 2 1MK* ^V3>2B, ^aiRsn^iBft 
*3c (83©F0) rtTRLi + Ci + B,,,^** 
HAIR_AVEi©i*l, ^Q-Jl^-SB 1 * 
I = 1 0 0 x (Gi.,/25 5) 
ft, (1) ST, G <^»J-» ©iB*ffi*ffll»TC>S 
©&, ^y->©BBR«M*. Affl<Z)BTMTjBDS?8K 
*«fcSRT*-&fe©/c3&>6T*-S. LftUte&b, 
< 1 ) sStcfctvc, GfiKCR<u?K), B 20 

1=4 0 + 0. 6X1 

[0026] 7 s - * 7 t 69JK*J 1 ©B#©RG B 

(RK GL B 1 ) ffl*«#HJU C©RGB (R 

0, GO, BO) <t, 7EH«ORGBffl[t€r*S»^ * 

Rnew=rateXRO + (1-rate) x R 1 
Gnew=rateXGO + (1-rate) x G 1 
Bnew=ratexBO + (1-rate) xb 1 



(5) «N»2 0 0 0- 1 5 1 98 5 

8 

tgjc u fcBK« iHi;^ ju©ia*«r &fi$iB% <t -f 

S. C©<fc9KLT, ^ya>2tt. SttMtcSflift* 
*S"TSCt*«T«5. 

[0 0 2 3 ] CCt, mt bX x a— r^j ©7 
>RB 2 (85) £iiiRWci§£ (82©*r 
^'S 10 8), ^V3>2», 9IK#0>*> 1 00O 
BSoSK&ORGBfflOTattSn/c-f-^^ 7 •fJ^I^' 

[oo24]itc, ^ya>2tt ( mmmmm<DW& i 



(1) 

5K [0025] <t C *>T, SCftl?©«©fe^*©»^, I 
«T©<fc9«:LT ( 1 ) ST*&/c I ©ffi£* 

tr< ur^esft-rsci^Tts. 

(2) 

★ (rate) T«T©<l:5K:fiO^*)-&-5. CO«^tt 
^&|g©fe i«^-r -5 * 2 a - ;l/-r?~ S B 



(3) 



(Rn e w, Gnew, Bn ew) £, *HR<t&S»M 

«ffi3R©H*ffl£-r*. 30 
[0 0 2 7 ] cn*T©*aa^wA:i, e*^ftt/fc« 
«*sjiH©««i«cD**r, am«**DTi/*^sn 

#T#S. <fc «««Bi*^6flte6StiS 

[0 0 2 8 ]-*. (2) StC»^*IB5S*»liLfc 40 
Ufc) H«tett-5Tb*5Cia*£l>. CMSit^) 

> + - 77;, ^©x v it&mam&i otticj: 

[0 0 2 9 ] fii^^/cIg^C'i < 

©s^a^i/Tc^it^cctt, *r, e»©«««rigjR 

LX (H3) , ±5#©MIi ( (1 ) - (3) St) 4ff 

l> % BIMCC. *.»©«««rj«W0T (83) . ±#©& 50 



9 ( (1 ) - (3) £) *fT*.«fll>. 
[0 0 3 0 ] a— tf-ti, ^T*7-©<ktt*»7lfc 
OK4<^>B 1 »J *ftKJ:»3 

<B2©Xt^:/S1 0 9) . atWKWfi© 
ffiffi£aft-r*»& (120^f 77*S1 1 OTYe s 

<om^) , a— tf-tt. rR-5j #*>B3**y?$? 

-r^Ci^T^S. ^tx(C<t*p, ^ya>2tt, 02© 
7D-*^f^S105^iRU Wg^2©^-/7 
Pd^#^^ (84) ft. «T 

[003 1 1 XIC, a-if-ti, T7^:3>££hj£ 
ii^L/cb©<b-r-5o -^n6Cj:0, ^va>2tt l ^5 

^feTrp^©7^n>^>? h©fe«S^r^ r«j 
T^S. 



[ o o 3 2 ] tr, mmmommmz. t&mv i * 

(^3) r^u/cgcoM^cfc^r, tmmm<0RG 

1(1 = 0. 3xR (t1 + 0. 59XG,., + 0. 11XB * 

E,.,= I Xm.i'Xu I + I X|. 
I X,.,*.-Xi.i I + I X,. 

[0034]^v3>2it *fft«*rtr. ±te^ ? ^ 

10[)WlAve_edge^^ fl MK % 
rttE ( .i^A ve_e d g eJ;0**Wti«, *©ffii 

jRttx 9 iswmv&z tmrnt &o io 
[0 03 5 ] 82tt7^»j>y*aa*tT^. ^* 

i ( i =7^) B©««rtt?ffia©»fc* 

[0 03 6 ] *>rt>*«J<W-C, Ri.i+G^i+B,.,© 
ffi©HMI£\ Eye_maxitT^^, Eye„ 
max(CHff£©ffi«. W*tf0. 3 5*^fcfe©«:T 
H_E Y E <t B£W«ca©««rtr, R,,, + G,., 20 
+ B 1 . i ©ffi#TH__EYE<fc9/hi*0 (Tfcto-feTH 
_E YE J: OHIO H*ffl©»^*«»WK:B<D«« 

(tralP) <t*f& 0 C©«fc9fcLT#a&&hfcB©WfII 

3«tJ:D#&6ftfcB©««*^*Br&*. t©J;^ 
KUT. A'v3>2il 6ttWKB©««*3R«>*C£ 

[0 0 3 7 ] <LC6T, a<W*«:te^raDiHktt. ±* 

strips <&*t£<!:&*. fi^or, @©««» % ** 

H6 (a) K^*fc©£&£rarr*>£#, KlfiTFL 
EYE©^P»ci;ottl H6 (b) CCtjVT £5 
tc. B©ttfB©T**UE (jStB-CTS-raW) 

[0 0 3 8 ] :#&&;hfcB©tt«#, B6 ( b ) 
J:5&fc©£ttofc*l£r*>* g©B£#tf>£t <t#T 

*f * £ * B»©»#» 6 rtSBCC|0i3&> o r ft 3 if 40 

#©^f*«©m JBWm»©»Hi»«:«ffl-c*4. 
[0 0 3 9]-*, ffil«»Snfcll»*'C«WS*tC 

a±©*^ift*. c©»«, H»«:rtis^*rt«n© so 



(6) «p« 2000-151985 
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[0 0 3 3 ] MK, ^©JlS4HSi©^ 
i.i-X,,, I + 

i-,-X,m I (4) 

rtJgn©*8tt, *x£fW 

[004 0 ] B©feS»«:*jiir »©^©ea»i 
0«©*&ffi*ff5. c©i§^4>, s»w©B©e*«i© 
( l ) stttfttt* I ©ffittffi< c©HJgr 

£tW\®tC. (1) ^£ffll>T I ©{!£*£< 

fflftrsiac^. x?y2tt©«yi, x?s>j^©«iii 

[0 04 l]^, a— B4£te^T, Ty^ 
7^*- J £»JRLfcfe©<!:-rS. **tft<fci5. Aya 
>2li, B5fc»iH0/c»3©^7ny«K7** 

s^d^a-;^-, r^^-f^ix^^aaH-r^K^i* 
©7^7^^-©6«c^-r5 rjRj r#j j 

fs>iPZ>7 4 ^^>ELCCOlirti, ^ 
d7n--;^--cfSffi3tifc«KTx^S/*Slur 1 7^ 

t©ii£w:fci, x 9 s?istt©*aa x-vi/W© 

-1f-*S7 >^rff ^tc* <r*s<fc9tcurfcfi 

[0 04 3 ] ^CC, a— r7-f^+K-j*iS 

ffl(HUc»3©y^7ay#7^^ (^fhtS) *a^-r 

j8JR3ti/cffl««©ll(fc, 7^'>+K-©B 
*K^.SX^n-jUA-, 7-Tvt K-©ft"C7UJE©7 
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[00441 H7W\ T^->t K-©«H*iS*riaT* 
S. ^-*f-{$, Z$u-)l^-%ffll<>X. T^vt F 

SnfcT^^t F-<D*BE SR^6, T-Y5>+F-ES 
[0045 ] Etc, M-ya>2«, T -f F-««© 

[0 046 ] 4/c. ±mbtczj*-*s>#)mtmi 
tc, g^estfta^n, + F-©«a«:S<-r 

2\ B3&5 6©ElB©^*7-?'-^ (l*P*>0*T) <bLT 
iSJUOfeittS. ^SAMKltt (3) 

i^cim^ *j*5*jffliecj:«3, r^*F-© 

X_ l _ I b=X_l_l 
X_r_lb=X_r_] 
Y_u_ l b=Y_u_l -He i 
Y„d„ l b = Y_d_l -He i 

frfrzmmmftv, s<o«m<omatm«<o^mxtE 

[0 04 9 ] »©fi«COtiTtt. rfij&CDT^n-CDfe 

**t^*SiS*|piw:l£^ t Si/JvrtitfJ; 
[0 05 0 ] #CC, a-tf-tt, r^g?J £»iRUfc«> 

©£-r£„ -entc^o, ^V3>2tt. H5fc»ttit,fc 
i3©^rD^^7 <*bs> ^a^-f&o c© 

i©x v ^^©R^StSE*.** £ u-^'-^St^ 

[0 0 5 1 ] A©S#©if «SMEtt. @©ffl«J: OTC 
□©««<!: 9 ±©«H-C\ *?L*aMtiU *?L©ttH*> 

, . , + B, . , ©fit©¥fc)fiiJ: 0 ^3 tttiK. A7Ultt£ f 
*U*<fcC>. *Ett2ooA?L©SiI2ir»ia±-C 
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* [0 04 7 1 9IK, n.-lf-tt. rr-^^P-J *jBIR 

j&©7-<:/a-©SKffl^T& rjlj r$j f ©7^ 

10 [ 0 0 4 8 ] ^ V 3 > 2 tc*5^T . «©8M*©«I»5e 

©M^OfWaBHEittWrSHr**. fci^tf. ^8 
CCSVTJcSK:. £SRE*ffltrtE£««©a:±. *ll 

st. fiTcaasr^ti-en, <x_ 1 _ 1 . y_u_ 

1), (X_r_l , Y_u_l ) , <X_ 1 _ 1 . Y 
_d_l ) , (X„r_l , Y_d_l ) tUX, 
©*I4*$«r^n^tiWi dth_l, Height. 
li-T-Si. *<0««©fi±. 6±, ST, £T©Hi£ 
(X_ 1 _ 1 b, Y_u„l b) , (X_r__l b. Y 
20 _u_lb), (X_l_ib, Y_d_lb), (X 
_r_l b. Y_d_lb) l«*i*ftKT©J:5«:it 



ght_l 

ght_l (5) 

[0 0 5 2] a— !f-tt, **6^fc*SS«:ffl^-r-Sx 

30 Dtx^^-r^ciim^ jhw#3W£*>6 

S/c^ri^Ji^tt, *«©*«©!?*«< U JHW 

[0 0 5 3]^. a— f-tt. r^->7j ^riMlRL/c 
^©it^o -e-;Mc<J:9, ^V3>2tt, HStCJSUHL 

[0 0 5 4 ] B9t*. «©««©H3E*ttM-r^fc«)© 
*'C»*ylS«iL, B<Dmti!iX&ttiLtcm<Dtp<b£xm 

mtbx, *s*witaf r 7*ji/n§*«<D*^cRc 

^6*a©*^*t?(DEIII©0. 5fg<bL^cR^}ffl< C 
iCC J: 0 . s!P5!PSR'rffl*ti/c«l«**««CRi-rh 

50 ©*S*^6tx-5J:5«:-CtS. PS, toiHtt, « 



(3) 
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©aftlftec^b-er «n 1 1 % c 4 fc r*# 

[0 0 5 5 ] JK»JWKtta~lf--# 1 ^*#£>ril 

[0 0 5 6 ] *tc, a— !f-tt, rpflj ZmiRLtcb 
S 3 ©3^ 7 n (*HS) £ft^T6o CCD 10 

$^7u aj«sn/ciiffl«©aift, g 

[ 0 0 5 7 ] *?\ P©«««r*«)Sfc«). »*BiSR© 
RGBfl©JSJB*PX,.i«r**S. C<OUmm. 
«X,., = 0. 21xR 1i1 -0. 52x0,^ + 0. 3 

1 xB.M'Cltg^n^o 

[0 0 5 8 ]yc(C, HH 4 x^^fi 20 

E E,.,tittT©a;"catoStiS. 

E,.,= I Xio.i-X (ll I + I XLa.rX.M I + I 
Xi . 1 ♦! ~~ Xi . 1 I I Xi.-t_-i~Xi.-i I 
^A^Mi»*C®lI_x v ^«©¥i*lfflA v e_e 
d ge**W. »*««rtrE«. 1 #A v e__e d g 

[0 0 5 9 ] HK, 8 2«"7^<y>y«91«f^. 

£W\ HD^Jl^flffiU ^-^©5-^UDMSA 30 
i ( i P©«*rtrffi«©*«>;* 

[0 0 6 0 ] B*«rtrR, .1 +Gi.i + B tl i OW-ty® 

r*3. a-if--ccJ:0a«SnfcPiB[C!)etc«c 
^^^./cC^ta:^!^^, «/Jvr*itfJ:t>. c© 

j:5k:ot. ^V3>2u, e»wccpffl««ram-rs 

Ci*Stt*. 40 
[0 0 6 1 ] *»CC, a-if-tf. r7 7 >f-^3 
>J fcaNO/ct©*-*"*. **iOCj:9 % AV3>2 

ilk) t©^7P^^*&U** jKR£ 

ftfc»fiW*©iffi«k Mfe©«H*8;ia*i>n--;U^ 
~ <btt©«3 4aitS^i7 0-;u^^ HKDS-CrSJE 

[ o o 6 2 ] sr, me««*ttffi-f *Hffl*A*u 
a, p^tts&^Hiefiiiaittffl-r*. a so 
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KJartoaiftoWJBfiix.M ccr, i f j 

W&«X, . , = R, . , + G, . 1 + B, TfWSti*. 
[0 0 6 3 ] :£cc, Hffl4H*4©_£**«>, x?i;j: 
E,.i E.^ttfiiToaT**?**!*. 
Ei .1 = I X,M.rXi,i I + I X^.rX,,! I + I 
Xi . 1 »i *~ X| . i I + I Xi.i_j~Xi.i I 

r«fc<, B£tt©««> r*>&<, KWStifcP©* 

«rt&»nKKe««-c*si«3ers. ft. «©« 

rtrg, p<o«i«:aiHr*J:9tt:brfcllo. 
[0 064] a-lf-te <fc 9BtR$;hfc7 7 >r > s 

«S§l«A3rcoas«jt«©«S3^«i^a^. 7c©flfe4 
«©^A-^>^©is^t»«:«<-rtitf<fcii. -enocct 

[0 0 6 5 ] c©J:5tc, *Si*©»««:J:tiK. a- 

ttfett-rafii©^*:!!*!^^. L^fciE*«:»fflU, 
MK:a-if-©B*K:j»cr. mmMtlB£<DC£ < &m 

[006 6] EK:, *jHt.©JB«©a»W<_: LT , <fc 0 
■«K{|«ft*««3Wil6ti-5. /ciA^ ^2© 

y-frpy#^^x©ieig«iOT, r i oftj r2 0 

[0 0 6 7] J: *-j*#^«*«»r*{t 
tt©ll!WtWBBSllyrte*. *ticc»(6br. ±^0 
fc*8Mt*tc^7^-3f (Wtt©e^, 9SftKT©e<bS 

^-r-sw^. H*©*s*fis*> y^eytc 

ii«©»(4©a*«:i«ii-r4ci*ir , *-s. t>^^. 
rs#j tj^aj r^j ic^fcj: 

[0 0 6 8 ] *>^*|S®«iecJ:ti«. H©SS[5{4©^}ft 

^ys-$ zmm h m r 4 -sa^* 7 > - * & gssw 

[0 0 6 9 ) *©(feklB&0!l4l/rW % 

*©ttSd*J#te**c4*>?ittr**. *tt©fttttt. 



(9) 

15 

ife $ tifc t bX fc Bfifcft i > J; 9 K g ti£ C ± < , 

CCD J: ^ tcfHSStottfllk &14©{b$£K£ 5 J: 5 
^7>-^K^^^ s ft. F514©]M8«k:, 

6, ¥£©ftffi©»£K:tt. Ifiit&^ci^<, 3k 10 

9KififflL/dbtt*, a~if--©»«fccJ:<5, 
[0 0 7 1 ] &«^©a»rr*&&, a-1f-*$ 
S. W*tfa--1f--#, ^7*5~©feKJS"Jfrfe£)JDA 

o^ro^^^ (H5) cca^snfc rjBRj *' 

^>B4*ff-ri, HI OCCtkTJ:^ ^TUv-O 

[0 07 2] JEfc, i-if-tt, <bffiD n n^-#-©tl2fi 
T*^©*rfe**9Aft/dbtt*, «^fcH««glS 30 
■*-*C<!:t>**.e>tlS. hi ott^?. ^ 

7 * 5 - ©if fc fcfe *iKR* * 7 a ? 2 * *c fc 
or. a— »f-tt, ^yn>2 3&S7^*XpISBttge»Jj| 
ftiUTCDCD-ROM fcU < ttii<i#Si Or©-/ 
h^iiWrt-So ^SCD-ROMCCtt, 
{ tffln n D^ - * - £ fe© * * tit 4d 0 , 

a— *f-W\ CD-ROM*aJRLfctl^, WSCD 

s. 

[0 07 3 ]-*, a-tf-#. y h «rffltR 40 

TtU*. {tfflD n D^-*CO^-A^-> ; ^CC7^-fe^-C 
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